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Abstract 

In this paper we evaluate the entanglement assisted classical ca- 
pacity of a class of quantum channels with long-term memory, which 
are convex combinations of memoryless channels. The memory of such 
channels can be considered to be given by a Markov chain which is 
aperiodic but not irreducible. This class of channels was introduced 
in [7], where its product state capacity was evaluated. 



1 Introduction 



The biggest hurdle in the path of efficient information transmission is the 
presence of noise, in both classical and quantum channels. This noise causes 
a distortion of the information sent through the channel. Error-correcting 
codes are used to overcome this problem. Messages are encoded into code- 
words, which are then sent through the channel. Information transmission 
is said to be reliable if the probability of error, in decoding the output of 
the channel, vanishes asymptotically in the number of uses of the channel 
(see e.g. |1] and [22] )■ The aim is to achieve reliable transmission, whilst 
optimizing the rate, i.e., the ratio between the size of the message and its 
corresponding codeword. The optimal rate of reliable transmission is referred 
to as the capacity of the channel. 

A classical communications channel has a unique capacity, the formula 
for which was obtained by Shannon in 1948. A quantum channel, in con- 
trast, has various distinct capacities. This is because there is flexibility in the 
use of a quantum channel. The particular definition of the capacity which 
is applicable, depends on the following: (i) whether the information trans- 
mitted is classical or quantum; (ii) whether the sendei0, Alice, is allowed 
to use inputs entangled over various uses of the channel or whether she is 
only allowed to use product state inputs; {iii) whether the receiver. Bob, is 
allowed to make collective measurements over multiple outputs of the chan- 
nel or whether he is only allowed to measure the output of each channel use 
separately; (iv) whether Alice and Bob have additional resources e.g. prior 
shared entanglement. 

The different capacities resulting from the different choices mentioned 
above were evaluated initially for memoryles^ quantum channels. The ca- 
pacity of a quantum memoryless channel for transmitting classical infor- 
mation, obtained under the restriction that the inputs are product states 
and that collective measurements are made on the outputs, is referred to as 
the product state (classical) capacity of the channel. The formula for this 
capacity is given by the Holevo-Schumacher- Westmoreland (HSW) Theorem 
[13, [2H]- The formula for the quantum capacity of a memoryless channel, i.e., 
its capacity for transmitting quantum information, was established through 
a series of papers [251 EDI EZl HOl US]- The maximum asymptotic rate of re- 
liable transmission of classical information with the help of unlimited prior 
entanglement between the sender and the receiver is known as entanglement 

"'^We follow the normal convention and refer to the sender as Alice, and the receiver as 
Bob. 

^ For such a channel, the noise affecting successive input states is assumed to be per- 
fectly uncorrelated. 
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assisted capacity. The formula for this was first obtained by Bennett, Shor, 
Smohn and Thaphyal [SI E] and the proof was later simplified by Holevo 
[in] . These proofs are based on the HS W Theorem. For an alternative proof, 
based on a packing argument, see [T7] . 

The assumption of uncorrelated noise in quantum channels cannot be 
always justified, and memory effects should be accounted for. To our knowl- 
edge, the first paper concerning a quantum channel with memory was by 
Macchiavello and Palma ^1]. In [3], an important class of quantum channels 
with memory, called forgetful channels (cf. pjlj) was introduced. In such a 
channel, the correlation in the noise, acting on inputs to the channel, decays 
with the number of channel uses. See also [8] and [2]. 

The capacities of channels with long-term memory (i.e., channels which 
are "not forgetful"), had remained an open problem until recently. In [7], 
the classical capacity of a class of quantum channels with long-term mem- 
ory, which are given by convex combinations of memoryless channels, was 
evaluated. This is perhaps the simplest class of models of "not forgetful" 
quantum channels. For further example of such channels see [9|. In this pa- 
per we evaluate the entanglement-assisted classical capacity of the same class 
of channels as in ^. For a channel $ in this class, : BiH'^'') S(/C®") 
and the action of on any state p(") e is given as follows: 

M 

(1) 

i=l 

where 0i : BiH) B{IC), {i = 1,...,M) are completely positive, trace- 
preserving (CPT) maps and 7^ > 0, '^fii 7j = 1. Here H and /C denote finite- 
dimensional Hilbert spaces and B(H) denotes the algebra of linear operators 
acting on Ti. On using the channel, an initial random choice is made as to 
which memoryless channel the successive input states are to be transmitted 
through. A classical version of such a channel was introduced by Jacobs [IS] 
and studied further by Ahlswede [I]. 

Note that the memory of the class of channels that we study, can be con- 
sidered to be given by a Markov chain which is aperiodic but not irreducible. 
This can be seen as follows. Consider a quantum channel (of length n) with 
Markovian correlated noise given by a CPT map : i3(7i®") S(/C®'^), 
which is defined as follows: 

M 

il,...,i„=l 

Here [i) qij denote the elements of the transition matrix of a discrete-time 
Markov chain with a finite state space I = {1, 2, . . . , M}; (ii) {'~fi}^i denotes 
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the invariant distribution of the chain, and {iii) for each i ^ I, (p^ : B{T-C) — >■ 
B{)C) is a CPT map. Casting the channel defined by ([T]) in this form yields 
Qij = Hence the transition matrix of the Markov chain, in this case, is the 
identity matrix. In other words, once a particular branch i G {1, . . . , M} has 
been chosen, the successive inputs are sent through this branch. Transition 
between the different branches (which correspond to the different states of 
the Markov Chain) is not permitted. The Markov chain is therefore aperiodic 
but not irreducible. Hence the channel has long-term memory and does not 
lie in the class of forgetful channels. 

We start the main body of our paper with some preliminaries in Section [21 
Our main result, giving the expression for the entanglement-assisted classical 
capacity of the channels in question, is stated as a theorem in Section [SI The 
proofs of the converse and direct parts of this theorem our given in Sections 
13.11 and 13.21 respectively. In proving the direct part of the theorem, we make 
use of the expression for the product state capacity of the channel, which 
was obtained in [7]. 

2 Preliminaries 

The von Neumann entropy of a state p, i.e., a positive operator of unit trace 
in B{7i), is defined as S{p) := — Trplogp, where the logarithm is taken to 
base 2. A quantum channel is given by a completely positive trace-preserving 
(CPT) map $ : Bili.) B{JC), where H and K. are the input and output 
Hilbert spaces of the channel. For any ensemble {pj,Pj} of states pj chosen 
with probabilities pj, the Holevo x quantity is defined as 

x{{Pj, Pj}) ■■= S (^Pj Pi j - J2p^ ^^P^^- (2) 

3 Main Result 

As mentioned in the Introduction, in this paper we evaluate the entanglement- 
assisted classical capacity of the class of channels with long-term memory 
defined by ([I]). 

Consider the following protocol for the entanglement-assisted transmis- 
sion of classical information through such a quantum channel. Suppose 
Alice and Bob share indefinitely many copies of an entangled pure state 
^AB ^ |^AB^^^AB| g j^f^^^ ^ j^^y YLeie the system A{B), with Hilbert 

space I-La (J^b) is in Alice's (Bob's) possession and dimTi^ = dimTi^. Sup- 
pose Alice has a set of messages, labelled by the elements of the set A1„ = 
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{1,2,..., M„}, which she would hke to communicate via the quantum chan- 
nel ([T]) to Bob, exploiting this shared entanglement. For this purpose she 
uses encoding (CPT) maps E := (where J is some positive integer) 

acting on B{^a). In order to transmit her classical messages through the 
quantum channel, Alice encodes each of her messages in a quantum state 
in (TYa ® 'Hb)®'^ in the following manner. To each a G M.n she assigns a 
quantum state (or codeword) 

where 

for /c = 1, . . . , n. Here £ {1, • • • , and idB denotes the identity map in 
-B(Hb). 

Note that the codewords are states shared between Alice and Bob. Alice 
then sends her part of these shared states to Bob through n subsequent uses 
of the quantum channel ([T]). Hence, Bob's final state corresponding to Alice's 
classical message a is 

ar'":= (<^>(")®^(i|")p^^'^ (5) 

In order to infer the message that Alice communicated to him. Bob makes a 
measurement on the state cr^^'", the measurement being described by POVM 
elements F^'^'", a = 1, . . . , M^, with iM-B;n being a positive operator acting 
in {Ua ^UbT'', such that 

and Iab denoting the identity operator acting in Ha'^'Hb- Defining p^^'"- ■= 
{I A ® /s)®" - Ef=i yields a resolution of identity in (Ha ®'Hb)®''. 

Hence, J" := {F^^'''}f^o defines a POVM. An output /3 e A<„ of a mea- 
surement described by this POVM, would lead Bob to conclude that the 
codeword was p^^'", whereas the output is interpreted as a failure of any 
inference. 

The encoding and decoding operations, employed to achieve reliable trans- 
mission of information by means of this protocol, together define a quantum 
code C^"-* (of length n) which is given by the triple C^") := (M„,£,J^), with 
Mn denoting its size, and being the encoding and decoding maps em- 
ployed. 
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Assuming equidistribution of messages, the average probabihty of error 
for the code C*^"^ is given by 

Pe(C(")) := ^ E (1 - (Fr^-l-^"^"^ ® <")(pr^"))) ■ (6) 

" a=l 

If for a given R> there exists a sequence of M^s with 

i? < hm inf — log M„, 

and a sequence of codes C^"^ of size M„ such that 

hm Pe(C(")) = 0, 

n— »oo 

then R is said to be an achievable rate. 

We define the one-s/iot entanglement-assisted classical capacity [TU] of the 
long-term memory channel defined by ([T]) as 

Cia (^) ■= sup sup [P : R achievable] , (7) 

where the internal supremum is over the rates achievable under the choice of 
the initial shared state \E'^'^jf| 

More generally Alice and Bob may share indefinitely many copies of a 
pure state v['^^;™ in (TCa Tis)®™ for some given m > 1. In this case 
Alice can perform a similar construction using encoding CPT maps, Sj"^\ 
which act in Ti'j^. In other words, she uses m-block encoding, and encodes 
a message a G A^„ by the state 



I 5 



where 



for = 1, . . . , n and jk G {!,..., J}. 

As before. Bob uses decoding POVM elements F^^'"- which are positive 

operators acting in {Ha^'HbT'^'' , with Y.a2i F^,^'"" < ifT- 

The average probability of error for the resultant code (which we denote 
by Cm^) is given by 



■^In the case of a memoryless channel, this reduces to an alternative expression referring 
to a single use of the channel [cf., e.g., eq.(l) in [16]]. 
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This gives rise to the m-shot entanglement-assisted classical capacity of 
the long-term memory channel defined by ([T]): 

C(^)($) := sup sup [i? : achievable] , (9) 

\J>AS;m 

where the internal supremum is over the rates achievable under the choice of 
the initial shared state \|/"^^'™. 

Finally, the full entanglement-assisted classical capacity of $ is given by 

Ce„($) :=limsup-C(:^)(*) (10) 

m— >oo ^ 

Our main result is given by the following theorem. 

Theorem 3.1 The entanglement assisted classical capacity of a channel $, 
with long-term memory, defined through ^\), is given by 

Cea(<f)=max A. /(p;0,) , (11) 

p L' 

with I {p; (pi) := S (p) + S {(t>i{p)) — S {p; (pi) , where S {p; (pi) denotes the entropy 
exchange and is defined as follows: 

S{p;(P,):=S{{(Pi0zd^)^f'')), (12) 

with ip'^^ being a purification of p on a reference system R. In 177]) the 
maximum is taken over states p G B{1-La)- 

Here we use the standard notation f\ to denote the minimum. 



3.1 Proof of the converse part of Theorem 13JJ 

In this section we prove that for any rate R > Cea{^), with Cea($) given 
by ( |TT]) . reliable entanglement-assisted transmission of classical information 
from Alice to Bob via the quantum channel $ (eq.([l|)) is impossible, regard- 
less of the encoding used. 

Suppose Alice and Bob share multiple copies of an entangled bipartite 
pure state vl/^-^'"^ in {'Ha^'Hb)^"^, where m is a given positive integer. Then, 
given n G Z, Alice encodes her classical messages by applying chosen m-block 
encoding CPT maps, n times, to her part of the shared state (\|/^-B;m^®n_ 
Here we show that the average error probability of the corresponding code, 
as defined in ([H|), does not tend to zero as ^ oo, for any m and any choice 
of encoding maps. For notational simplicity, we will omit the label m and 
the superscript AB in the rest of this section. 
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Let 

denote Bob's final state, if tlie codeword 

pl = Pc.,i®---®Pc.,n e B{(nA®nBr^''). (13) 

corresponding to tlie message a, is transmitted tlirougli tfie i-tli brancli of 
the cliannel. Here a^^kii) = (0j ® idB)Pa fc; fo'^ ^ = 1) 2, . . . , n. Also let 

M 

i=l '"I aeA1„ 

and = 77^7 X] , for fc = l,...,n. 

Then the average probability of error ([H]) equals 

M"^ 1 - E Tr K<] • (14) 

We also define the average probability of error corresponding to the i*^ branch 
of the channel as 



M 

PiJ 



1 



Let X*-"-* be a random variable with a uniform distribution over the set 
M.ni characterizing the classical message sent by Alice to Bob. Let f/"^ 
be the random variable corresponding to Bob's inference of Alice's message, 
when the codeword is transmitted through the i*^ branch of the channel. It 
is defined by the conditional probabilities 

P [r/") = (3 I X(") = a] = Tr [F;(0r ® (Pa)]- (16) 
By Fano's inequality, 

MpS?)+pl:ilog(|-Mn|-l)>//(X(")|r/"))=i7(X("))-i7(X(") : Yt^). 

(17) 

Here h{p) := — plogp— (1— p) log(l— p) denotes the binary entropy, H{A) := 
— Pa log Pa denotes the Shannon entropy of a random variable A with 
probability mass function p^, and H{A\B), H{A : B) denote, respectively, the 
conditional entropy and the mutual information [4J of two random variables 
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A and B. Using the Holevo bound and the subadditivity of the von Neumann 
entropy we have 

mx<"' : y/"') < s(j^ J: -j^ E s «(.))) 



< 



E 



k=l VU-'^'nl J aeM„/ 

n _ n 

= E ucn E sK,ki^)\\-^k^)) :=E^^- (18) 

k=l ' aGMn k=l 

In the above the symbol ^(pllci;) denotes the quantum relative entropy of 
states p and u. 

The expression Vk can be rewritten using Donald's identity pj]: 

YpaS{uJa\\p) = ^PaSiuJa 1 1 t^) + S{lo\\p), (19) 

where uj = J^aPoi^ci- apply this with p replaced by 

1 " 

' fc=l aGAIn 

ciJa replaced by cr^ f^ii), Pa replaced by and consequently u replaced 

by (x^(«). Hence, 

^ E ^K,;.«ii^«)' (21) 

where we have used the non-negativity of the quantum relative entropy. In- 
serting this into (ITSl) we now have: 

1 1 



fc=l aGA4r; 



xM^^'^a.W^ 1- (22) 



n\Mn\ 



The inequality (ITTl) now yields (cf. eq.(17) of [T6]) 

Mpff)+p!?log|Atn| > log \Mn\-nx( I ^lr^,a^,,{i) 

\[n\Mn\ 

> \og\Mn\-nI{p,<f),), (23) 

where 



P 



a.fe 



with pa^k '■= I ■ , I for each a and fc, and p^j. = Tr B(pQ,fc), k = 1, . . . ,n. 

^ I -/^^ n I 



However, since 



M 



C,am> l\l{p,(t>i) (24) 

i=l 

and R = \ log |A^n| > Cea($), there must be at least one branch i such that 
We conclude from (fTHI) and that 



M 



Hence p^^^ does not tend to zero as n — » oo, which in turn implies that 



r A ^ 

Cea($) < max A. I{p- 

p L' '«=! 



□ 



3.2 Proof of the direct part of Theorem 13.1 



In this section we prove that Cea($), defined by ffTUl) satisfies the lower bound 

r A A/ 1 
aa($) > max A /(p;0,) , (27) 

p L' 

where the maximum is taken over all states p G B{T-Ca)- 

To prove this we employ the following result which we proved in [7]: 
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Theorem 3.2 The product state capacity of a channel $, with long-term 
memory, defined through (QP, is given by 

M n 

■ ' ~ (28) 



C($)= sup \/\ XiiUj^Pj}) 



where Xiii'^j^ Pj}) '■= X ({^j? 0i(Pj)})- The supremum is taken over all finite 
ensembles of states pj G BiTi), chosen with probabilities Hj. 

From the definition ([7]) of the one-shot entanglement assisted capacity 
and fl28p it follows that 

A. M{n„{<P.®zdB)pf}) , (29) 

where (i) "^"^^ is the bipartite entangled pure state, indefinitely many copies 
of which are shared by Alice and Bob, and (ii) Sj are encoding maps acting 
on B(Ha), as described in Sectional i.e., pf^ = {Sj ® i(i^)\E''^^. 

Moreover, from the definition of the m-shot entanglement assisted 
capacity it follows that 

CL™)($) = sup \K\xi{^t^, ® ^dT)pfn)] ■ (30) 

Now, following [6] and [IE], consider a specific encoding ensemble {'^^(^l),^(a'b)}^ 
where a,b = 1,2, ... ,q, for some integer q, and 

(m) _ J_ . p(m) _ TT^(m) 

Here VF^^™'' denotes the discrete Weyl-Segal operators (see e.g. [IB]) for a q- 
dimensional subspace Qm of 7i^™. Further, consider the codewords to be 
given by 

C'"^ = (w^i?®<")(iO(^n), 

where \ip^^) denotes a maximally entangled state of rank q: 

where {\G^k^^)}'l^i is an orthonormal system of vectors in Qm. Hence, 
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From [16] it follows that 

x({^,(0r®^c;r)Cn) = /(;^r(^;0r), (32) 

where P^*") is the orthoprojection onto Qm- Further, it was proved in [16] 
that if Qm is chosen to be the strongly 5-typical subspace for an arbitrary 
state p®'" e B{nf^), and P"^'^ is its orthoprojection, then 

1 pm,5 

lim lim -Ht^ttt^-AT) =Hp-Ai) (33) 

From flHTj) . flH^ . ([33]) and the definition (fTUj) of the full entanglement-assisted 
capacity, it follows that 

A M 
' •«=1 

□ 
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